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ABSTRACT 

This paper explores tlie relationships between a computational theory of temporal representation 
(as developed by James Allen) and a formal linguistic theory of tense (as developed by Norbcrt 
Homstein) and aspect. It aims to provide explicit answers to four fiindamental questions: (1) what is the 
computational justification for the primitives of a linguistic theory; (2) what is the computational 
explanation of the formal grammatical constraints; (3) what are the processing constraints imposed on the 
learnability and markedness of these theoretical constructs; and (4) what are the constraints that a 
linguistic theory imposes on representations. We show that one can effectively exploit tlie interface 
between the language faculty and the cognitive faculties by using linguistic constraints to determine 
restrictions on the cognitive representations and vice versa. 

Three main results are obtained: (1) We derive an explanation of an observed grammatical 
constraint on tense -- tlie Linear Order Constraint -- from tlie information nionotonicity property of the 
constraint propagation algorithm of Allen's temporal system: (2) We formulate a principle of markedness 
for the basic tense structures based on tlie computational efficiency of tlic temporal representations; and 
(3) We show Allen's interval-based temporal system is not arbitrary, but it can be used to explain 
independently motivated linguistic constraints on tense and aspect interpretations. 

We also claim that the mcdiodology of research developed in tliis study -- "cross-level" 
investigation of independently motivated formal grammatical theory and computational models -- is a 
powerful paradigm with which to attack representational problems in basic cognitive domains, e.g., space, 
time, causality, etc. 
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1. Objectives and Main Results 

One major effort in modern linguistics is to limit the class of possible grammars to those that are 
psychologically real. A grammar is psychologically real if it is (a) realizable - possessing a computational 
model tliat can reproduce certain psychological resource complexity measures, and (b) Icarnable - capable 
of being acquired (at least, in principle) despite the poor quality of input linguistic data. A shift of 
emphasis from the. pure characterization problem of grammar to the realization and learnability problems 
naturally brings linguistics closer to AI work in natural language understanding concerned with 
computational models of language use and language acquisition. Computational study is in principle 
complementary to more formal and abstract grammatical theory. Each should contribute to the other. 

The purpose of this paper is to work out an example of how formal grammatical theory and 
computational models can effectively constrain each other's representations. In particular, I seek to 
explore four fundamentalissues: 

1. How is the choice of primitive structures in grammatical theory to be justified? 

2. What is the explanation of the rules and constraints tliat have to be stipulated at the 
grammatical level? 

3. How are these knowledge structures acquired? 

4. What are the theoretical constraints imposed by the grammar on the representational scheme of 
the computation theory? 

What I hope to show is that structures and principles tliat have to be stipulated at the grammatical 
level fall out naturally as consequences of the properties of the algorithms and representations of the 
underlying computational model. In so doing, I will also resu-ict the class of plausible computational 
models to those that can explain or incorporate the constraints imposed by tlie formal grammatical 
tlieory. 

There are a number of requirements that must be met in order for such "cross-level" study to 
succeed. First, there is a sizable collection of facts and data from the target domain to be explained. 
Second, there is independent motivation for the theory of grammar - it is empirically adequate. And, 
third, the computational model is also independently motivated by being sufficiently expressive and 
computationally efficient. 

With these considerations, I have chosen two domains: (1) tense and (2) aspect. Tense concerns the 
chronological ordering of situations with respect to some reference moment, usually the moment of 
speech. Aspect is the study of situation types and perspectives from which a particular situation can be 



viewed or evaluated. The point of departure of tiiis study is two papers; (1) for die tlicory of tense, 
Hornstein's "Towards a theory of Tense" (Mornstcin77) and (2) for die cognitive Uieory of time, James 
Allen's "Towards a General Theory of Action and Time" (Allen84). 

In the following, I shall list die main results of diis study: 

1. A better dieory of tense widi revised primidve tense structures and constraints. 

2. We derive an explanation of Hornstein's Linear Order Constraint, an observed formal 
constraint on linguistic tense, from properties of die constraint propagation algorithm of 
Allen's temporal system. This shows this formal grammatical constraint need not be learned 
at all. We also show diat the rule of R-permanence follows from die hypodiesis that only the 
matrix clause and the subcategorizable SCOMP or VCOMP can introduce distinct S and R 
points. Finally, we prove diat certain boundedncss condition on die flow of information of a 
processing system leads directly to die locality property of a constraint on sequences of tense. 

3. A principle of markedness for tense structures based on die computational efficiency of die 
temporal representation. The principle predicts diat (1) of die six basic tenses in English, 
future perfect is die only marked tense, and (2) die notion of a distant future tense, just like die 
simple future, is also unmarked. 

4. A better account of die state/event/process disdnction based on Allen's interval-based 

temporal logic and die idea that die progressive aspect specifies die perspecdve from which die 
trudi of a situation is evaluated. 

5. An account of theoretical constraints on die represcntadon of dme at the computadonal level, 
e.g., three disdnct dme points are necessary to characterize an elementary tensed sentence, and 
die disdnction between insuintancous and non-instantaneous dme intervals. This shows that 
Allen's interval-based scheme is not arbitrary, but is modvated by independent linguistic 
constraints. 



^ 1. This definition of aspect is .slightly narrower than that accepted by most linguist. For instance, Comrie defined aspect as 
"different ways of viewing the internal temporal constitucnc)' of a situation". (Comrie76) 



2, Tense 

We begin by first outlining Hornstein's theory of tense. In section 2.1, we describe the primitives 
and constraints on tense of his tlieory. In sections 2.2 and 2.3, we show how die primitives and constraints 
can be derived from computational considerations. 

2.1 Revisions to Hornstein's Tlicory of Tense 

Hornstein develops a theory of tense within the Reichcnbachian framework which postulates three 
theoretical entities: S (the moment of speech), R (a reference point), and E (the moment of event). The 
key idea is that certain linear orderings of the three time points get grammaticalized into the six basic 
tenses of English. The following is the list of basic tense structures: 

1. SIMPLE PAST E,R_S 

2. PAST PERFECT E_R_S 

3. SIMPLE PRESENT S,R,E 

4. PRESENT PERFECT E_S,R 

5. SIMPLE FUTURE S_R,E 

6. FUTURE PERFECT S_E_R 

The notation here demands some explanation. The underscore symbol "_" is interpreted as the 
"less-than" relation among time points whereas die comma symbol "," stands for the 
"less-tiian-or-equal-to" relation. As an illustration, the present perfect tense denotes a situation in which 
die moment of speech is eitiier cotcmporaneous or precedes die reference point, while die moment of 
event is strictiy before die otiier two moments. Note diat Hornstein also uses die term "association" to 
refer to die comma symbol ",". 

Given the basic tense structure for a simple tensed sentence, the interpretation of the sentence that 
arises from die interaction of tense and time adverbs is represented by die modification of die position of 
die R or E points to form a new tense structure which we call a derived tense structure. In two papers 
(Homstein77 & HornstelnSl), Hornstein proposes direc formal constraints diat limit die class of derived 
tense stiuctures diat can be generated from the basic tense structures in such a way as to capture the 
acceptability of sentences containing temporal adverbs (e.g., now, yesterday, tomorrow), temporal 
connectives (e.g., when, before, after), and indirect speech. In the rest of diis section, 1 shall examine the 
adequacy of these constraints. 



2. Hornstein actually listed nine basic tenses, but I think the progressive belongs to the province of aspect rather than tense. 
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2.1.1 Linear Order Constraint 

The Linear Order Constraint (LOC) states that (p.523-4): 

(1) The linear order of a derived tense structure must be the same as the linear order of the basic 
structure. 

(2) No new association is produced in the derived tense structure. 

LOC is stipulated to account for examples consisting of a single temporal adverb such as (4a) and 
those witli two time adverbs such as (32).^ 

4a. John came home i. •now, at this very moment 
ii. yesterday 
iii. •tomorrow 

32 a. John left a week ago [from] yesterday. 

b. [From] Yesterday, John left a week ago. 

c. *A week ago, John left [from] yesterday. 

The basic tense structure for 4(ai) is: 

E,R S (simple past: John came home) 

TVow modifies E or R so that they become cotemporaneous with the moment of speech S with the derived 
tense structure as follows: - 

E,R,S (BAD: violates LOC since new association is produced) 

On tlie other hand, 4(aii) is acceptable because of the permissible derived tense structure: 

yesterday 
E,R_S -^ E,R_S (OK: does not violate LOC) 

The crucial example, however, is 5(c): 

5c. John, has come home i. ?right now 

ii . •tomorrow 
iii. yesterday. 



3. The numbering;; are Hornstein's. 

4. See foolnoie 7 and 11 of Hornstein's paper. 
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LOC predicts (wrongly) tliat 5cii is good and 5ciii bad. But LOC gives the wrong prediction only on the 
assumption that the basic tense structures arc correct. To account for 5c, I propose to save tlic LOC and 
change tlie following SRE association with tlie present perfect: 

PRESENT PERFECT E_R,S 

With the modified basic tense structure for present perfect, LOC will give the correct analysis. 5cii is bad 
because: 

tomorrow 4i 

E R,S -* E S R (linear order violated) 

5ciii is acceptable since: 

yesterday 

E R,S -+ E R S (OK since no new linear order 

and no comma introduced) 

The proposed modification also accounts for tlie unacceptability of sentence (48b) for which Hornstein 
has to appeal to some sort of Gricean maxims of conversation. 

48b. *[From] Tomorrow John has climbed Mt. Everest three times (in the 
past/last year). 

The analysis of 48b is: ■ 

tomorrow, last year 
E R,S -* E_S R (linear order is not maintained) 

The question that naturally arises at this point is: Why does Hornstein not choose my proposed SRE 
structure for the present perfect? The answer, I believe, will become apparent when we examine 
Hornstein's second constraint. 

2.L2 Rule for Temporal Connectives 

The rule for temporal connectives (RTC) states that (p.539-40): 

For a sentence of the form Pi -conn-P2, where "conn" is a temporal connective such as "when", "before", 
"after" etc., line up the S points of Pj and P2, that is, write the tense structure of Pj^ and P2, lining up the 



5. There may be doubts as regards the acceptability of 5ciii. An equivalent form of Sciii is acceptable is Danish (Jespersen65, 
p.'271). Also, in French, the present perfect can be used for a situation that held not more than 24 hours before the present moment 
(Comrie76, p.61). 
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S points. Move R2 to under R2, placing 1^2 accordingly to preserve LOC on tlic basic tense structure. 

It can be easily seen that my proposed tense stniclure for present perfect docs not work with RTC since it 
produces tlie wrong predictions for the following two sentences: 

[1] *John came when we have arrived. 
[2] John comes when wc have arrived. 

For [1] the new analysis is: 

E,R_S -+ E.R_S 

I I 

E_R,S E_R_S 

which does not violate tlie RTC and hence predicts (wrongly) that [1] is acceptable. Similarly, for [2], the 
hew analysis is: 

S.R.E -+ S.R.E (violates RTC) 

I I 

E_R,S E_S.R 

which predicts (wrongly) that [2] is bad. 

This may explain why Hornstein decides to use E_S,R for the present perfect because it can 
account for [1] and [2] with no difficulty. However, I suggest that the correct move should be to abandon 
RTC which has an asymmetrical property, i.e., it matters whether Pj^ or P-, is put on top, and docs not 
have an obvious semantic explanation. (See Homsiein's footnote 20, p.543). My second proposal is then 
to replace RTC with a Rule of R-permanence (RP) stating that: 

(RP): Both the S and R points of Pj^ and ?2 ^^^^ ^^ aligned without any manipulation of the tense 
structure for P2' 

Thus sentence [3]: 

[3] John came when we had arrived. 

is acceptable because its tense structure does not violate RP: 



6. There is a typographic error in Homstein's paper where it is mistakenly stated as "lining up the Rs". 



E,R S (OK: S and R points are already aligned) 

• E_R_S 

Now, let us reconsider sentences [1] and [2]. Sentence [1] is not acceptable under RP and the new tense 
structure for present perfect since: 

E,R S (violates RP; the two R's are not aligned) 

E_R,S 

Sentence [2] is still a problem. Here I shall make my third proposal, namely, that the simple present 
admits two basic tense structures: 

SIMPLE PRESENT S,R,E and E,R,S 

Given this modification, sentence [2] will now be acceptable since: 

E,R,S (S and R points are aligned) 

E_R,S 

To examine the adequacy of RP, let us look at more examples: 

[4] John has come when i. *we arrived 

ii . *we had arrived 

iii. we arrive 

iv. we have arrived 

v. *we will arrive 

The corresponding analysis is as follows: 



[4'] i. E R.S 
E,R S 


(BAD) 


ii. E_R,S 
E R S 


(BAD) 


iii. E R,S 
E.R.S 


(OK) 


iv. E R.S 
E_R,S 


. (OK) 


V. E_R,S 

S R.E 


(BAD) 
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Wc can sec that the proposed theory correctly predicts all of the five cases. There is. however, an apparent 
counter-example to RP which, unlike RTC, is symmetrical, i.e., it does not matter which of the Pj's is put 
on the top. Consider tlie following two sentences: 

[5] i. John win come when we arrive, 
ii. *John arrives when we will come. 

RP predicts both 5i and 5ii will be unacceptable, but 5i seems to be good. It is examples like 5i and 5ii, I 
believe, that lead Hornstein to propose the asymmetrical rule RTC. But I diink tlie data are misleading 
because it seems to be an idiosyncrasy of English grammar that 5i is acceptable. In French, we have to 
say an equivalent of "John will come when we will arrive" with the temporal adverbial explicitly marked 
with the future tense (Jespersen65, p.264). Thus, die acceptability of sentences like 5i can be explained by 
a principle of Economy of Speech allowing us to omit tlic future tense of the temporal adverbial if the 
matrix clause is already marked with die future tense. The same kind of explanation also works for 
examples 5iii and 5iv: 

[5] iii. John win come when we have arrived, 
iv. *John has come when we win arrive. 

where 5iii is really short for "John will come when we will have arrived" which is acceptable. 

2.1.3 Sequences of Tense 

Now, we describe the third and final grammatical constraint on sequences of tense. Consider the 
following sentences: 

[6] John said a week ago that Mary (a) win leave in 3 days. 

. (b) would 

[7] John said yesterday that Mary (a) left 3 days ago. 

(b) had left 

In the (a) sentences, die temporal interpretation of the embedded sentence is evaluated with respect to die 
moment of speech. Thus, for instance, [6a] means that Mary's leaving is 3 days after present moment of 
speech. On die odier hand, die (b) sentences have die intcrpretadons evaluated widi respect to die 
interpretadons of die matrix clause. That is to say, [6b] means diat Mary's leaving is 4 days before die 
moment of speech. 

To account for die sequence of tense in reported speech, Hornstein proposes die following rule: 

(SOT): For a sentence of die form "P-^ diat P2", assign S2 wiUi Ej. 

In general, for an n-level embedded sentence, SOT states diat: assign Sj^ with E^,-^ (HornsteinSl, p.l40). 
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With ihc SOT rule, [6a] and [6b] will be analyzed as follows: 

[6a' 3 a week ago 

I 

Ei.Ri_Si 

$2 R2'^2 ""-* ^2 ""^ ^ ^^y^ after Sj 

I 
in three days 

[6b'] a week ago 

I . 
Ej.Rl ^i 

I 

$2 R2.E2 ==> E2 is 4 days before Sj 

I 
in three days 

The local property of SOT, i.e., linking occurs only between nth and (n-l)th level, has a nice 
consequence: it explains why a third level nested sentence like [8]: 

[8] John said a week ago (a) 

that Harry would believe in 3 days (b) 

that Mary (i) will leave for London in 2 days (c) 
(ii) would 

has only two temporal readings: (1) in 8(ci). Mary's leaving is two days after the moment of speech, and 
(2) in 8(cii), Mary's leaving is two days before the moment of speech. In particular, there is not a 
temporal reading corresponding to die situation in which Mary's leaving is five days before the moment 
of speech. We would obtain die tliird reading if SOT allowed non-local linking, e.g., assigned S3 with Ei . 

2,2 Explanations of the Formal Constraints 

In the previous section, we have examined three formal constraints on the derivation of complex 
tense structures from the basic tense structures: (1) LOG, (2) RP, and (3) SOT. Now, I want to show how 
the LOG falls out naturally from the computational propenies of a temporal reasoning system along the 
line suggested by Allen (Allen84, Allen83), and also how the RP and SOT constraints have intuitive 
computational motivation. 

The basis of Allen's computational system is a temporal logic based on intervals instead of dme 
points. The temporal logic consists of seven basic relations and their inverses (Allen84, p.I29, figure 1): 
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Rel ation symbol symbol for inverse 



X before Y 




< 


> 


XXX YYY 


X equal Y 




= . 


= 


XXX 
YYY 


X meets Y 




m . 


mi 


XXXYYY 


X overlaps 


Y 





oi 


XXX 
YYY 


X during Y 




d 


di 


XXX 
YYYYY 


X starts Y 




s 


si 


XXX 
YYYY 


X finishes 


Y 


f 


fi 


XXX 
YYYY 



The reasoning scheme is a form of constraint propagation in a network of event nodes linked by temporal 
relationships. For instance, tlie situation as described in the sentence "John arrived when wc came" is 
represented by tlie network; 

A — (> < m mi =) — > B 

( < ) ^( < ) 

NOW 

where A = John's arrival and B = Our coming 

This network means that both event A and event B are before now, the moment of speech, while A can be . 
before, after or simultaneous with B. 

When new temporal relationships are added, the system maintains consistency among events by 
propagating tlie effects of the new relationships via a Tahk of Transitivity Relationships that tells the 
system how to deduce the set of admissible relationships between events A and C given the rcladonships 
between A and B, and between B and C. Thus, for instance, from the relationships "A during B" and "B 
< C", the system can deduce "A < C". 

One property of the constraint propagation algorithm' generally is that flirther information only 
causes removal of members from the set of admissible labels, i.e., temporal relationships, between any 
two old events (Allen83, p.835). No new label can be added to the admissible set once it is created. Let us 
call this property of the constraint propagation algorithm the Delete Label Condition (DLC). DLC can 
be interpreted as a kind of information nionotonicity condition on the temporal representation. 
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Let us further restrict Allen's temporal logic to instantaneous intervals, i.e.. each .event corresponds 
to a single moment of lime. The restricted logic has only one primitive relation, <, and tlirce otlicr 
derived relations: <, >, and >. There is a straightforward translation of Hornstein's SRE notation into the 
network representation, namely, replace each comma symbol "," by < (or > with tJie event symbols 
reverse tlicir roles) and each underscore symbol "_" by > (or < with similar adjustment on the event 
symbols). Thus, a tense structure such as: E_R,S can be represented as: 

V S -{>)->E 

\ ^ 

{>=)(>) 

V/ 

R 

With this representation scheme, we can prove the following theorem; 
(Tl) DLC -*LOC 
Proof 

Let A and B range over { S, R, E } and A 9^ B. There are five basic types of violations of the LOC: 

LA_a-*B_A 
2. A_B -> A,B 
3.A_B -+B,A • 
4. A,B -^ B,A 
5.A,B -*B_A 

We can see that each of these cases is a violation of tlie DLC. To spell this out, we have the following 
operations on the constraint network corresponding to the above violations of the LOC: 

r.A-(<)->B -*A-(>)->B 
2'. A -( < )-> B -♦ A -( < = )->B 
3'. A -( < )-> B -+ A -( > = )->B 
4'.A-(< = )->B -^A-(> = )->B 
5'.A-(< = )->B -fA-(>)->B 

In each of these cases, the operation involves the addition of new members to the admissible set This is 
ruled out by DLC. Thus, we have the result that if LOC is violated, tlien DLC is violated. In other 
words, DLC -+ LOC.'^ H - 



■ 7. The converse of this theorem is not true, i.e.. there are cases in which DLC is violated but the LOC is still obeyed. 
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Thc second constraint to be accounted for is tiic l^F which effectively stiues tJiat (a) the S points of 
the matrix clause and tlic temporal adverbial must be identical, and (b) the R points of tlie matrix clause 
and tlic temporal adverbial must be identical. One hypothesis for this rule is that: 

(HI) Only the matrix clause introduces distinct S and R points. 

Q 

In other words, tlie non-subcatcgorizable temporal adjuncts do not add new S and R points. 

HI has to be modified slightly to take the case of embedded sentence into account, namely, 

(Revised RP): Only the matrix clause and the subcategorizable SCOMP or VCOMP can introduce 
distinct S and R points. 

where SCOMP and VCOMP stand for sentential complement and verbal complement respectively. The 
interesting point is diat both the revised RP and die locality property of SOT can be easily implemented 
in processing systems which have certain boundedness constraint on the phrase stnicture rules (e.g., 
information cannot move across more tlian one bounding node). To illustrate this, let us consider the 
following tense interpretation rules embedded in the phrase structure rules of the Lexical-Functional 
Grammar (Kaplan82): 

S -+ MP VP 
(i S-POINT) = NOW 

VP -4 V (NP) (ADVP) (S') 

(4- S-POINT) =({ T E-POINT) if (^ tense) = PAST 
tNOW otherwise 
ADVP -^ Adv S 
S ' -» COMP S 
Adv — ♦ when 

( T T-REL) = { <.>, = ,m,nii } . 

before 
( T T-REL) = { > } 

The S rule introduces a new S point and sets its value to now. The VP rule has two effects: (1) it does not 
introduce new S or R points for tlie temporal adverbial phrase, thus implicitly incorporating the revised 
RP rule, and (2) it looks at the tense of the embedded sentential complement, setting the value of its S 
point to that of the E point of the higher clause if tlie tense is past, and to now, otherwise. Thus, in this 
way, the second effect accomplishes what the SOT rule demands. 



8. These are temporal adverbs which can have multiple occurrences, can be fronted, and are omissible without affecting the 
meaning of the matrix clause. 
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2.3 Implications for Learning 

If the revisions to Hornstcin's theory of tense arc correct, the natural question to be asked is: How 
do speakers attain such knowledge? This question has two parts: (1) How do speakers acquire the formal 
constraints on SRE derivation? and (2) How do speakers learn to associate tlie appropriate SRE structures 
witli tlie basic tenses of the language? 

Let us consider the first sub-question. In the case of LOC, we have a neat answer -- the constraint 
need NOT be learned at all! We have shown that LOC falls out naturally as a consequence of the 
architecture and processing algorithm of tlie computational system. As regards the constraint RP, the 
learner has to acquire something similar to HI. But HI is a fairly simple hypotliesis that does not seem to 
require induction on extensive linguistic data. Finally, as we have shown in the previous section, the 
boundedness of the flow of information of a processing system (as, for instance, illustrated in the phrase 
structure rules of tlie Lexical-Functional Grammar) leads directly to the locality property of the SOT. 
The particular linking of S and E points as stipulated by the SOT, however, is a parameter of the 
Universal Grammar that has to be fixed. 

What about the second sub-question? How do speakers learn to pair SRE configurations with the 
basic tenses? There are 24 possible SRE configurations seven of which get grammaticalized. Here I want 
to propose a principle of markcdness of SRE structures that has a natural computational motivation. 

Let us recall our restrictive temporal logic of instantaneous interval with one primitive relation, <, 
and three derived relations: <,>, and >. Represent a SRE configuration as follows: 

S > E 

\/ 

The admissible labels are among {<,<=,>,>=}. So there are altogether 64 possible configurations that 
can be classified into three types: 

(1) Inconsistent labelings (16), e.g., 

S -{>)-> E 

\ ^ 

(<) {<) 

v/ 

R - 
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(2) Labelings that do not constrain the SE link given the labelings of SR 
and RE (32), e.g. : . . 



s 


-(?) 


-> E 


\ 




f 


(< 


) 

V 


(>) 



(3) Labelings that are consistent and the SE link is constrained by the 
SR and RE link (16), e.g. , 

S -(<)-> E 

\ / 
(<) (<) 

V 

If we assume tliat labelings of the tlilrd type correspond to the unmarked SRE configurations, the 
following division of unmarked and marked configurations is obtained: 



UNMARKED 



MARKED 



E R S 


PAST PERFECT 


E S R 




E.R_S . 


SIMPLE PAST 


E,S_R 




E_R,S 


PRESENT PERFECT 


E S.R 




E,R,S 


SIMPLE PRESENT 


E.S.R 




S.R.E 


SIMPLE PRESENT 


S E R 


FUTURE PERFECT 


S,R E 




S_E,R 




S_R,E 


SIMPLE FUTURE 


S,E_R 




SRE 




S,E,R 

R_S_E 

R_S,E 

RES 

R E,S 

R.E S 

R,S_E 

R.E.S 

R.S.E 





The interesting result is that five out of the six basic tenses have unmarked SRE configurations. 
This agrees largely widi our pretheorctical intuition that the SRE configurations that correspond to die 
basic tenses should be more "unmarked" than other possible SRE configurations. The fit, however, is not 
exact because the future perfect tense becomes tlic marked tense in this classification. 
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Another prediction by this principle of mnrkedncss is tJiat both tlic simple future {S_R.E) and 
distant future (S_R_E) arc unmarked. It would be interesting to find out whether there are languages 
in which the distant future actually gets grammaticalizcd. 

The final point to be made is about the second type of labclings. There are two other possible ways 
of grouping tlie labelings: (1) given SR and SE, those labelings in which RE is constrained, and (2) given 
SE and RE, those in which SR is constrained. But these types of grouping are less likely because they 
would yield die simple present tense as a marked tense. Thus, they can be rijled out by relatively few 
linguistic data. 

2.4 Implications for Cognitive Representation 

I have already touched on the cognitive representation of dme in various places in the previous 
sections. Here I just want to reiterate two important points. First, the computational constraint to 
maintain consistency of temporal relationships has theoretical significance inasmuch as the formal 
constraint LOC follows directly from the processing characteristics of the constraint propagation 
algorithm and the representation method. 

Second, the grammatical tlieory requires the representation of three different moments of time for a 
tensed sentence. However, as far as the problem of tense is concerned, a temporal structure <T,<> with 
linear ordering of time points will suffice. To make use of the full power of Allen's temporal logic, we 
have to consider the problem of verb aspect. That is the topic of die next few sections. 
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3. Verb Aspect 

The two main problems of the study of verb aspect are the correct characterization of (1) the three 
fundamental types of verb predication according to the situation types that tliey signify -- slate, process 
and event, and (2) the perspectives from which a situation is viewed, or its truth evaluated -- simple or 
progressive. In the first part of his paper, Allen attempts to provide a formal account of the 
state/process/event distinction using a temporal logic. However, I believe tliat his characterization fails 
to capture well-known patterns of tense implications, and docs not make the distinction between situation 
types and perspective types fundamental to any adequate account of verb aspect. In the next section, I 
will present some data that any theory of verb aspect must be able to explain. 

3.1 Data 

3.1.1 Tense Implications 

1. Statives rarely take the progressive aspect " , e.g., 

I know the answer. 

*I am knowing tlie answer. 

2. For verb predications denoting processes, the progressive of the verb form entails the perfect form, i.e., 

X is V-ing — > X has V-ed. 
For instance, 

John is walking -+ John has walked. 

3. For verb predications denoting events, the progressive of the verb form entails the negation of the 
perfect form, i.e., 

X is V-ing -♦ X has not V-ed. 
For instance, 

John is building a house -+ John has not built the house. 



9. Some of the better works in the literature are: Vendlcr67. Kenny63, Comric76,Mourelatos78. ■ 

10. It has often been pointed out that some statives do taice the progressive form. Eg., "I am thinking about the exam.", "The 
doctor is seeing a patient" However, a concrete piece of evidence is provided by Ota in his study of tense and aspect usage 
involving written material and ordinary conversation which shows that there is a class of verb, including familiar statives such as 
"believe", "think", "see", "know", that rarely occurs with the progressi've aspect- less than 2% of the total occurrences of the verb. 
(Ota63, section 2.2) 
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3.1.2 Sentences containing \\hcn 

Sentences containing clauses connected by a connective such as "when" have different aspect 
interpretations depending on the situation types and perspective types involved. 

[9] John laughed when Mary drew a circle. 

Situation/Perspective type: X = process/simple; Y = event/simple 
interpretation: X can be before, after or simultaneous with Y 

[10] John was laughing when Mary drew a circle. 

Situation/Perspective type: X = process/progressive; Y = event/simple . 
Interpretation: Y occurs during X. 

[11] John was angry when Mary drew a circle. 

Situation/Perspective type: X = state/simple; Y = event/simple 
Interpretation: X can be before, after, simultaneous with or during Y. 

[12] John was laughing when Mary was drawing a circle. 

Situation/Perspective type: X = process/progressive; Y = event/progressive 
Interpretation: X must be simultaneous with Y. 

3.1.3 Sentences containing Before/After 

When the temporal connective is "before" or "after", the adverbial clause cannot contain the 
progressive aspect. 

[13] John laughed before/after Mary painted the wall. 

[14] John laughed *before/*aftcr Mary was painting tlie wall. 

[15] John lauglied before/after Mary was angry. 

3.1.4 Event Verb with Present Perfect Tense 

An event verb with present perfect tense cannot have a continuati ve aspect reading: 

[16] He has lived in Cambridge for the past 3 months. (CONTINUATIVE) 

[17] He has sailed in the sea for the past 3 months. (CONTINUATIVE) 

[18] He has asked tliis question for the past 3 months. (*CONTINUATIVE) 
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3.2 Formal Account of the Statc/l'roccss/Kveiit distinction 
Define: 

(a)XCY-^XdYVXsYVXfY 

(b) X C Y ** X C Y V X equal Y 

(c) mom(t) •*-♦ t is an instantaneous interval, i.e., consists of a single moment of time 

(d) per(t) ■«-♦ t is a non-instantaneous interval 

where X and Y are generic symbols denoting state, event or process. 

3.2.1 Progressive 

(PROG): OCCUR(PROG(v,t)) «- mom(t) A -' OCCUR(v,t) A (3 t')(t d t' A OCCUR(v,t')) 

The progressive aspect is the evaluation of a situation from an interior point t of the situation which has 
the property that though the sentence is not true at that instantaneous interval, it is true in a 
non-instantaneous interval t' properly containing t. 

3.2.2 State 

(SI): OCCUR(s,t) ** (V t'Xmom(t') A t' C t -^ OCCUR(s,t')) 

A state verb is true at every instantaneous interval oft. The definition is similar to Allen's H.l (Allen84, 
p.130). , ■ 

The following theorem shows that state verbs do not occur witli the progressive aspect. 

(S-THEOREM): *OCCUR(PROG(s,t)) ' 

Proof 

OCCUR(PROG(s,t)) ^ mom(t) A -i OCCUR(s,t) A (3 t')(t d t' A OCCUR(s,t')) 
-+ OCCUR(s,t') for some t' containing t 
-4 OCCUR(s,t) (by SI) 
.'.contradiction. H 



11. This section benefits from the insights of Barr>' Taylor (Taylor??). 
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This theorem raises the following question: Why do some stalivcs occur with tlie progressive? I 
think there are two answers. First, the verb in question may have a use other tlian tiie stative use (e.g. 
"have" is a stative when it means "possession", and not a stative when it means "experiencing" as in 
"John is having a good time in Paris.") Second, the English progressive may have a second meaning in 
addition to that characterized by PROG above. A frequent usage of tlie progressive is to indicate short 
duration or temporariness, e.g., in "They are living in Cambridge"/"They live in Cambridge". 

3.2.3 Process 

A process verb can be true only at an interval larger than a single moment. This property differs crucially 
from that of the statives. 

(PI): OCCUR(p,t) -* per(t) 

(P2): OCCUR(p,t) -* (V t')(per(t') A t' C t -* OCCUR(p,t')) 

The following theorem shows diat for a process verb, the progressive verb form entails tlie perfect form. 

(P-THEOREM) OCCUR(PROG(p,t)) -^ (3 t')(per(t') A t'< t A OCCUR(p,t')) 

Proof 

OCCUR(PROG(p,t)) -* mom(t) A -i OCCUR(p,t) A (3 t')(t d t' A OCCUR(p,t')) 

-♦ OCCUR(p,t') for some t' such that t d t' 

-+ 3mj6t'.m2^<t (sincetdt') 

— > 3m2€ t'. m2<m2<t (by density of dme points) 
Let t" be the interval [m^.mj]. Then, we have t" < t and t" C t'. By (P2), we have OCCUR(p,t"). That is, 
p has occurred. H. 

The characterization of process verb by Allen (his 0.2) is less satisfactory because it combines both 
the notion of progressive aspect (his "OCCURRING") and the process verb into the same axiom. 
Furtliermore, the difference between ilie predicate "OCCUR" and "OCCURRING" is not adequately 
explained in his paper. 

3.2.4 Event 

An event verb shares an important property with a process verb, namely, it can be true only at a 
non-instantaneous interval. 

(El): OCCUR(e,t) -* per(t) 

(E2): OCCUR(e,t) -* (V t')(per(f) A t' C t -^ -i OCCUR(e,f) 

The following theorem shows that the progressive form of an event verb entails the negation of the 
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perfect form. 

(E-THEOREM): OCCUR(PROG(c,t)) -^ -i(3 0(pcr(t') A f < t A OCCUR(e,t')) 

Proof 

As in the proof of (P-THEOREM), we can find a non -instantaneous interval t" sucii that t" < tandt" C 
t'. But for any such t", we have -> OCCUR(e,t") because of (E2). That is, it cannot be the case that e has 
occurred. H. . 

Again the crucial property (El) is not captured by Allen's characterization of events (his 0.1), 
3.3 Constraint on temporal interpretations involving When 

To account for the variety of aspect interpretations as presented in section 3.1.2, I propose the 
following constraint on situation/perspective type: 

(C-ASPECT): Let "dynamic" stand for a process or event. 

(a) simple/dynamic -+ mom(t) 

(b) simple/state -+per(t) 

(c) progressive/dynamic -+ per(t) AC 

Perspective is a way of looking at the situation type. For process or event, the simple aspect treats the 
situation as an instantaneous interval even though the situation itself may not be instantaneous. For state, 
the simple aspect retains its duration. The progressive aspect essentially views a process or event from its 
interior, thus requiring a stance in which the situation is a non-instantaneous inter\'al and the admissible 
temporal relationship to be the C relations, i.e., j; 5/; /yj; 4 i; e^ua/. 

Let me show graphically how C-ASPECT accounts for the aspect interpretations of sentences [9] to 
[12].. 

[9'] simple/process WHEN simple/event 

Admissible relations: 

< m = tni > 
X Y XY X YX Y X 
Y 



-22- 



[10'] progressive/process WHEN simple/event 
Admissible relations: 



si 


di 


fi 


XXX 


XXX 


XXX 


Y 


Y 


Y 



[11'] simple/state WHEN simple/event 

Admissible relations: 

> mi si di fi m < 

Y XXX YXXX XXX XXX XXX XXXY XXX Y 

Y Y Y 

[12'] progressive/process WHEN progressive/event 

Admissible relations: 



= 


f 


fi 


S 


si 


d 


di 


XXX 


XXX 


XXXX 


XXX 


XXXX 


XX 


XXXX 


YYY 


YYYY 


YYY 


YYYY 


YYY 


YYYY 


YY 



3.4 Constraint on temporal interpretations involving Before/After 

The constraint C-ASPECT also accounts for the fact that the temporal adverbial headed by 
"before" or "after" cannot contain the progressive aspect. Consider the analysis of [14]: 

[14'] simple/process BEFORE/AFTER progressive/event 

C-ASPECT allows three temporal interpretations for the sentence, namely, 
s d f 

X XX 

YYY YYY YYY - 

But the temporal connective "before" forces the interpretation X < Y whereas "after" forces X > Y. None 
of these interpretations is consistent with the admissible set allowed by C-ASPECT. Therefore, [14] is 
bad. On the other hand, sentences [13] and [15] will be acceptable since the interpretations forced by the 
temporal connectives are compatible with those admitted by C-ASPECT. 
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3.5 Constraints on Event \'crbs in the l*rcscnl I'crfect Tense 

Consider the following contrast: 

[19] John has sailed in the sea (a) for the last 3 months 

(b) in :., 

[20] John has been sailing in the sea (a) for the last 3 months 

(b) ?in 

In [19] the present perfect tense combines equally well with the adverbial "for the last 3 months" and "in 
the last three months". On the other hand, [20b] is much less acceptable tlian [20a]. This can be 
accounted for by the difference in truth conditions involving "for" and "in": 

(FOR): OCCUR(v,FOR T) -» (V t)(t C T -* OCCUR(v,t)) 

(IN): OCCUR(v.IN T) -♦ (3 t)(t C T A OCCUR(v.t)) 

Intuitively, if a situation occurs for an interval T, tlien the situation continues or lasts the whole period. 
But if a situation occurs in an interval T, it indicates there is an interval t properly contained in T during 
which the situation takes place. This explains why the present perfect progressive (P.P) does not occur 
with adverbials of die type "in the last n months/years" because the P.P requires a condnuous reading 
whereas the adverbial implies the situation is completed. 

Now, let us look at: 
[18] John has asked this question for the last 3 months. 

From (E-THEOREM), we see that for an event verb, the present perfect form implies tliere is a definite 
time interval before now during which die event is completed, and thus it is incompatible witli die 
present progressive form. That is to say, if x has V-ed, then x is not V-ing now. So, die event can neidicr 
continue nor last die whole period as demanded by the semandcs of die "for-adverbial", thus ruling out 
die continuative reading of [18]. 

3.6 Implications for Learning 

What is a possible aspect? Unlike tense, aspect is not reducible to purely temporal considerations. 
For instance, die semantic properties of state/process/event naturally call for a two dimensional analysis 
of dieir structures - a temporal axis and an acuvity axis. A state has'tcmporal duradon but is constant 
widi respect to die acdvity axis. 'Both process and event vary widi die activity axis, but diey differ in one 
crucial aspect: an event is bounded on die activity axis, i.e., approaching or rcsulung in a definite goal, 
while a process is unbounded. If diis explanation of die situation type disdncdon is correct, dien learning 
diis distinction will involve two binary choices: [± activity] and [± goal]. To spell diis out, we have: 
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activity go3l 
process + ^ 

event + + 

state - " 

IMPOSSIBLE - + . 

Given tliis picture of situation types, the perspective aspect can be interpreted as the selection of a 
point on the temporal axis from which a situation is viewed. Two stances are possible: one inside the 
duration of a situation and the other outside. These two perspectives correspond to the progressive and 
simple aspect that we find in English. Notice that there is no need to furtlier distinguish the outside 
stance into, say, the before-the-situation-duration and after-the-situation-duration stance. Such a 
distinction can be deduced from the combined effect of tense and simple aspect. 

There is a third kind of aspect that I have not discussed in this paper. Both the situation type and 
perspective aspect can be diought as topological properties, e.g., boundcdness on the activity axis. It is 
possible for a language to grammaticalizc melrical pwpcnks such as tlic lengdi of die duration in which a 
situation occurs, or tiie frequency of occurrence of a situation over a period of time. At present, however, 
I have no theory about this type of aspect. 

3.7 Implications for Cognitive Representation 

We have seen how Allen's inter\'al-based temporal logic can be used to capture a variety of 
semantic properties of situation types and perspective types. The disunction between instantaneous and 
non-instantaneous intervals turns out to play an important role in defining tlie progressive aspect, the 
three situation types and tlic constraint C-ASPECT. The latter constraint in particular reveals the role of 
a representation scheme in explaining phenomena that exist on a entirely different -- linguistic -- level. 
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4. Conclusion 

In this paper, I have examined two problems regarding linguistic semantics: tense and aspect. 
Important relationships between abstract constraints governing linguistic behavior and a computational 
scheme to reason about temporal relationships arc discussed. In particular, 1 have shown that certain 
formal constraints, such as the Linear Order Constraint on tense, fall out naturally as a consequence of 
some computational assumptions. An interesting result is that such formal constraints need not be 
learned at all. The study of linguistic semantics also sheds light on a rcpresentanon of time by revealing 
the fundamental distinctions that must be made, e.g., a tensed sentence involves three distinct time points, 
and the aspectual interpretations require instantaneous/non-instantaneous interval distinction. 

Future problems to study include: 

1. The computational architecture of tlie temporal reasoning system to show how learning of tense 
is possible. 

2. The adequacy and computational explanation of the C-ASPECT constraint. 

3. What is a possible aspect? How learning of aspect is possible? 

4. Apply the methodology to other cognitive domains, e.g., space, causality etc. 
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